Acceptance, commissioning, and ongoing benchmarking of a linear accelerator (LINAC) using an electronic portal imaging device (EPID)

ABSTRACT

The present invention is a method or system for acceptance testing and commissioning of a LINAC and treatment planning system (TPS). For a LINAC commissioning, the present invention collects reference data from a fully calibrated LINAC and compares the reference data with machine performance data collected from LINAC. The compared results are analyzed to assess accuracy of the testing LINAC. For a TPS commissioning, the present invention collects standard reference data from standard treatment plans and standard input data and compares the standard reference data with results from standard tests that are performed by a testing treatment plan system. The compares results are analyzed to assess accuracy of the testing treatment plan system.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a divisional application of U.S. patent applicationSer. No. 17/808,399, filed Jun. 23, 2022, which is a continuationapplication of U.S. patent application Ser. No. 17/212,065, filed Mar.25, 2021, now U.S. Pat. No. 11,393,582 issued Jul. 19, 2022, which is acontinuation application of U.S. patent application Ser. No. 16/738,402,filed Jan. 9, 2020, now U.S. Pat. No. 10,964,429, issued Mar. 30, 2021,which is a divisional application of U.S. patent application Ser. No.15/320,599, filed Dec. 20, 2016, now U.S. Pat. No. 10,553,313, issuedFeb. 4, 2020, which is a national phase application of InternationalPatent Application Ser. No. PCT/US2015/036749, filed on Jun. 19, 2015,which claims the benefit of U.S. Provisional Patent Application Ser. No.62/015,184, filed on Jun. 20, 2014, which are all incorporated herein byreference in their entireties.

BACKGROUND OF THE INVENTION

Many conventional methods for commissioning a linear accelerator (LINAC)equipped with an electronic portal image device (EPID) largely depend onindividual testing environment and parameters. Because individualtesting parameters are usually configured by an end user, certain levelsof machine performance variability can be found, some leading topotentially questionable quality of patient treatments.

Likewise, for treatment planning systems (TPS) work, local institutionsgenerally collect data and create their own plans and procedures forevaluation of a local TPS system. Because local data is unique to eachlocal testing environment, any performance variability in the system isdifficult to assess and evaluate due to the variability of input dataand testing processes. Furthermore, in the perspective of an end user ofTPS systems, it is not clear whether the performance variability in thesystem is caused by the variability of input data or an incorrectperformance or configuration of TPS systems.

The present invention is directed to overcoming one or more of theproblems set forth above.

SUMMARY OF INVENTION

This section provides a general summary of the disclosure and is not acomprehensive disclosure of its full scope or all of its features.

An aspect of this invention provides a system for acceptance testing andcommissioning a LINAC (linear accelerator), said system comprising: amemory storing first reference data wherein said first reference data iscollected from a reference machine composed of a LINAC and electronicportal imaging device (EPID), wherein said reference data represents atleast changes in radiation measurement at said EPID of said referencemachine in relation to changes in parameters of said LINAC of saidreference machine; a testing machine composed of a LINAC and EPID; and aprocessor associated with said memory, wherein said processor isconfigured to execute an analysis software program wherein said analysissoftware program collects machine performance data from said testingmachine wherein said machine performance data represents at leastchanges in radiation measurement at said EPID of said testing machine inrelation to changes in parameters of said LINAC of said testing machineand compares said first reference data with said machine performancedata to assess accuracy of said testing machine.

Another aspect of this invention provides a method for acceptancetesting and commissioning a LINAC (linear accelerator), said methodcomprising: collecting first reference data from a reference machinecomposed of a LINAC and electronic portal imaging device (EPID) whereinsaid reference data represents at least changes in radiation measurementat said EPID of said reference machine in relation to changes inparameters of said LINAC of said reference machine; storing said firstreference data in a memory associated with at least one processor;collecting machine performance data from a testing machine composed of aLINAC and EPID wherein said machine performance data represents at leastchanges in radiation measurement at said EPID of said testing machine inrelation to changes in parameters of said LINAC of said testing machine;and comparing, with an analysis software program, said first referencedata with said machine performance data to assess accuracy of saidtesting machine wherein said processor is configured to execute saidanalysis software program.

Still another aspect of this invention provides a system for acceptancetesting and commissioning a treatment planning system (TPS), said systemcomprising: a memory storing standard reference data wherein saidstandard reference data is composed of a plurality of treatment plansand predetermined results of such treatment plans; and a processorassociated with said memory having a test performance engine performinga plurality of standard tests based on standard input data andgenerating at least one test performance result for each standard testand an analysis software program comparing said test performance resultwith said standard reference data wherein said test performance resultis compared with at least one predetermined result of said treatmentplan and determining whether each said test performance result meets atolerance standard wherein said tolerance standard is a pre-determinedstandard corresponding to at least one of said standard tests, whereinsaid processor is configured to execute said test performance engine andanalysis software program.

Yet another aspect of this invention provides a method for acceptancetesting and commissioning a treatment planning system (TPS), said methodcomprising: collecting standard reference data wherein said standardreference data is composed of a plurality of treatment plans andpredetermined results of such treatment plans; storing said standardreference data in a memory associated with at least one processor;performing, with a test performance engine, a plurality of standardtests based on standard input data wherein said test performance enginegenerates at least one test performance result for each standard testwherein said processor is configured to execute said test performanceengine; comparing, with an analysis software program, said testperformance result with said standard reference data wherein said testperformance result is compared with at least one predetermined result ofsaid treatment plan wherein said processor is configured to execute saidanalysis software program; and determining, with said analysis softwareprogram, whether each said test performance result meets a tolerancestandard wherein said tolerance standard is a pre-determined standardcorresponding to at least one of said standard tests.

Another aspect of this invention provides the method for acceptancetesting and commissioning the treatment planning system (TPS) asdescribed the paragraph immediately above, wherein said steps ofperforming, comparing, and determining are performed by a softwareapplication wherein said software application comprises said testperformance engine and said analysis software program.

Another aspect of this invention provides the method for acceptancetesting and commissioning the treatment planning system (TPS) asdescribed in the paragraph immediately above, wherein said softwareapplication is configured to automatically perform said steps ofperforming, comparing, and determining.

Another aspect of this invention provides the method for acceptancetesting and commissioning the treatment planning system (TPS) asdescribed in the paragraph immediately above, wherein said softwareapplication is configured to perform said steps of performing,comparing, and determining in a pre-determined time interval.

Another aspect of this invention provides the method for acceptancetesting and commissioning the treatment planning system (TPS) asdescribed in the paragraph that is located three paragraphs above thisparagraph, wherein said analysis software program is configured toautomatically communicate to a medical service provider of said testperformance result when said test performance result fails to meet saidtolerance standard.

Another aspect of this invention provides the method for acceptancetesting and commissioning the treatment planning system (TPS) asdescribed in the paragraph that is located four paragraphs above thisparagraph, wherein said software application resides on a service-basedsystem wherein said standard reference data is stored in saidservice-based system.

Another aspect of this invention provides the method for acceptancetesting and commissioning the treatment planning system (TPS) asdescribed in the paragraph that is located six paragraphs above thisparagraph, wherein said standard input data comprises standard beamdata, standard images data, standard contour data, and standardtreatment plans.

In yet another aspect, this invention provides the system for acceptancetesting and commissioning the treatment planning system (TPS) asdescribed in the paragraph that is located eight paragraphs above thisparagraph, wherein said test performance engine and analysis softwareprogram are configured to automatically perform said processes ofperforming said standard tests, comparing said test performance resultwith said standard reference data, and determining whether said testperformance results meets a tolerance standard.

Another aspect of this invention provides the system for acceptancetesting and commissioning the treatment planning system (TPS) asdescribed in the paragraph immediately above, wherein said testperformance engine and analysis software program are configured toautomatically perform said processes of performing said standard tests,comparing said test performance result with said standard referencedata, and determining whether said test performance results meets atolerance standard in a pre-determined time interval.

Another aspect of this invention provides the system for acceptancetesting and commissioning the treatment planning system (TPS) asdescribed in the paragraph that is located two paragraphs above, whereinsaid test performance engine and analysis software program areconfigured to automatically communicate to a medical service provider ofsaid test performance result when said test performance result fails tomeet said tolerance standard.

Another aspect of this invention provides the system for acceptancetesting and commissioning the treatment planning system (TPS) asdescribed in the paragraph that is located eleven paragraphs above thisparagraph, wherein said test performance engine and analysis softwareprogram reside on a service-based system wherein said reference data isstored in said service-based system.

Another aspect of this invention provides the system for acceptancetesting and commissioning the treatment planning system (TPS) asdescribed in the paragraph that is located twelve paragraphs above thisparagraph, wherein said standard input data comprises standard beamdata, standard images data, standard contour data, and standardtreatment plans.

These are merely some of the innumerable aspects of the presentinvention and should not be deemed an all-inclusive listing of theinnumerable aspects associated with the present invention. These andother aspects will become apparent to those skilled in the art in lightof the following disclosure and accompanying drawings. The descriptionand specific examples in this summary are intended for purposes ofillustration only and are not intended to limit the scope of the presentdisclosure.

BRIEF DESCRIPTION OF DRAWINGS

The drawings described herein are for illustrative purposes only ofselected embodiments and not all possible implementations, and are notintended to limit the scope of the present disclosure.

FIG. 1 illustrates a schematic block diagram of a system for acceptancetesting and commissioning of a LINAC according to an illustrative, butnonlimiting, exemplary embodiment;

FIG. 2 illustrates a workflow of the computer program 110 of FIG. 1 foran illustrative, but nonlimiting embodiment;

FIG. 3 illustrates an example of relative measurements performed by theLINAC machine 120 of FIG. 1 utilizing a photon radiation beam for anillustrative, but nonlimiting embodiment;

FIG. 3A illustrates an alternative example of relative measurementsperformed by the LINAC machine 120 of FIG. 1 utilizing an electron beamfor an illustrative, but nonlimiting embodiment;

FIG. 4 illustrates a flowchart of a method for acceptance testing andcommissioning of a LINAC according to an illustrative, but nonlimiting,exemplary embodiment;

FIG. 5 illustrates a schematic block diagram of a system for acceptancetesting and commissioning of a TPS system according to an illustrative,but nonlimiting, exemplary embodiment; and

FIG. 6 illustrates a flowchart of a method for acceptance testing andcommissioning of a TPS system according to an illustrative, butnonlimiting, exemplary embodiment.

Reference characters in the written specification indicate correspondingitems shown throughout the drawing figures.

DETAILED DESCRIPTION OF THE INVENTION

In the following detailed description, numerous specific details are setforth in order to provide a thorough understanding of the invention.However, it will be understood by those skilled in the art that thepresent invention may be practiced without these specific details. Inother instances, well-known methods, procedures, and components have notbeen described in detail so as to obscure the present invention.

1. EPID-Commissioning

FIG. 1 is a schematic block diagram of an illustrative, but nonlimiting,system 100 for an exemplary embodiment of an EPID-commissioning system.The illustrative, but nonlimiting, exemplary system of FIG. 1 mayinclude a computer program 110, a LINAC machine 120, machine performancedata 130, analysis software 140, reference data 150, tolerance data 160,and a pass/fail report 170.

The computer program 110 can comprise any computer program code adaptedto control the processes of acceptance testing and commissioning of theLINAC machine 120 as described herein. In the exemplary embodiment, thecomputer program 110 is comprised of an extensible markup language (XML)code. It should be understood, however, that any other suitable programlanguages such as C/C++, Java, etc., can be used to encode the computerprogram 110.

The LINAC machine 120 includes at least a LINAC and an electronic portalimaging device (EPID). The LINAC of the LINAC machine 120 is a typicalLINAC that generates various types of radiation beams (e.g., MV photonbeams, kV photon beams, flattened and unflattened beams, electron beams,gamma ray beams (for non-LINAC applications of the present invention,etc.) used for various medical purposes. For example, certain types ofradiation beams are used for therapy purposes while other types ofradiation beams are used for imaging purposes. The LINAC can becontrolled with a number of different parameters such as internalmachine configuration changes and beam modifier insertion. The machineconfiguration changes include beam energy, radiation type, field size,multi leaf collimator shape, beam fluence alteration, medical purpose,etc. The beam modifiers include wedges, compensating filters, phantoms,etc., that can be inserted into the beam of a LINAC. The effect of thesechanges on characteristics of a LINAC beam can be evaluated with in-airand\or with in-phantom measurements.

In the exemplary embodiment, the LINAC machine 120 can be a referencemachine 122 or a testing machine 124. The reference machine 122 is usedto collect the reference data 150 for acceptance testing andcommissioning. Preferably, the reference machine 122 is fully calibratedand adjusted based on an industry standard. For example, the LINAC andEPID of the reference machine 122 can be calibrated and validatedaccording to one of the standards provided by the Accredited DosimetryCalibration Laboratory (ADCL). However, it should be understood that anysuitable method or standard for calibration can be used for purposesstated herein. The testing machine 124 is a LINAC machine that is beingtested and commissioned by the proposed method or system.

The reference data 150 preferably represents a correlation between theparameters and radiation measurement of the reference machine 122 (i.e.,representative of a properly configured LINAC machine). For example, thereference machine 122 detects differences in radiation measurement atthe EPID of the reference machine 122 in relation to any changes(changing individual parameters on a LINAC by known amounts) made to theparameters of the LINAC of the reference machine 122. In this way, thesystem 100 is configured to keep track of relative differences inradiation measurement at the EPID caused by changing the parameters ofthe LINAC. In the exemplary embodiment, the radiation measurement caninclude point radiation doses, dose profiles, planar dose distributions,percent depth doses, and three-dimensional dose distributions. It shouldbe understood that the radiation measurement can include other types ofinformation/data relating to the performance of a LINAC. In theexemplary embodiment, the reference data 150 can be stored in a memoryresiding on the system 100. Alternatively, any external memory devicecan be used to store the reference data 150.

The proposed EPID based data collection relies on acquiring twodimensional electronic images of radiation beams. These images can becollected with and without test phantoms in the path of an evaluatedbeam. Images of various beam modifiers (e.g., wedges, compensatingfilters, etc.) can be collected as well. By being able to relate theEPID images to a nominal performance of a LINAC through reference data,the images collected with EPID can be used to evaluate an individualmachine against an expected performance. By knowing how the referencedata is affected by changing of various LINAC parameters, EPIDs can alsobe used to characterize a LINAC machine which has not previously beenevaluated.

In the exemplary embodiment, the system 100 can comprise multiplereference machines 122 to collect multiple sets of reference data 150 toincrease accuracy and reliability of commissioning. For example, thesystem 100 can be configured to average the values of multiple sets ofreference data 150 obtained from multiple reference machines 122 and usethat average value as the reference data 150 for purposes ofcommissioning a testing machine 124 as stated herein.

The machine performance data 130 preferably represents a correlationbetween the parameters and radiation measurement of the testing machine124. Like the reference machine, the testing machine 124 measuresdifferences in radiation measurement at the EPID of the testing machine124 in relation to any changes made to the parameters of the LINAC ofthe testing machine 124. In the exemplary embodiment, the machineperformance data 130 can be stored in a memory residing on the system100. Alternatively, any external memory device can be used to store themachine performance data 130.

The machine performance data 130 is compared with the reference data 150in order to assess whether the LINAC of the testing machine 124accurately generates a proper amount of radiation according to inputdata provided by the user. In the exemplary embodiment, the analysissoftware 140 performs such comparison. The analysis software 140 isconfigured to compare the collected machine performance data 130 withthe reference data 150 and determine whether the machine performancedata 130 matches the reference data 150 within certain acceptancecriteria. If the difference between the machine performance data 130 andthe reference data 150 falls into that acceptable range of criteria,then the system 100 determines that the testing machine 124 is operatingaccurately.

This inventive concept relies on relative tests, comparison with thereference data 150, and a set of established tolerances to characterizeperformance of a LINAC. In this process, the collected machineperformance data 130 does not have to be fully corrected and can containasymmetries and other artifacts associated with backscatter and positionof an EPID during the collection of data. The reference data 150 whichwas generated from the reference machine 122 with EPID in the sameposition contains the same artifacts, and thus, as long as theimages/radiation measurement at the EPID of the testing machine 124matches within the established tolerances, the testing machine 124 wouldbe deemed acceptable for clinical use.

The established tolerances are not based on conventional dosimetrictolerances in radiotherapy (i.e., 3%/3 mm or 2%/2 mm, etc.) but ratherare a set of conversion factors. These factors, when applied to themachine performance data 130, can produce conventional dosimetrictolerances which are applied to data collected or calculated using theconventional dosimetric equipment to assess the physical machine energyand dose profiles. The relationship between the machine performance data130 and the reference data 150 can be defined by:[(Machine Performance Data (130))/(Reference Data (150))]*(ToleranceData (1) (160)=Conventional Acceptance Criteria

It should be understood that Equation (1) is provided only as an exampleand should not be used to limit the scope of the present invention. Anyother method or mathematical equation suitable to quantify therelationship between the machine performance data 130 and the referencedata 150 in a manner that is consistent with the descriptions providedherein can be also used.

In this exemplary embodiment, the tolerance data 160 represents apredetermined relationship between radiation measured by the EPID of thereference machine 122 and radiation measured by a conventional standardmethod (i.e., standard water tank measurement). For example, aconventional standard method can be one of the methods/reports issued bythe American Association of Physicists in Medicine (AAPM) Task Groups.In the exemplary embodiment, the tolerance data 160 can be stored in amemory residing on the system 100. Alternatively, any external memorydevice can be used to store the tolerance data 160. The conventionalstandard method is used to collect data for LINAC commissioning byscanning 1 D, 2D, and/or 3D images from a water tank. Any conventionaldata collection method which can be utilized by one of ordinary skill inthe art can be also used for purposes of collecting data.

After comparing the machine performance data 130 with reference data150, the analysis software 140 generates a pass/fail report 170. If themachine performance data 130 matches the reference data 150 withinacceptable criteria then the analysis software 140 generates a passreport. If the machine performance data 130 does not match the referencedata 150 within acceptable criteria then the analysis software 140generates a fail report.

In the exemplary embodiment, the computer program 110 can be configuredto automate the process of acceptance testing and commissioning. Forexample, the computer program 110 can be configured to automaticallydrive the testing machine 124 to collect the machine performance data130 and drive the analysis software 140 to compare the reference data150 with the machine performance data 130 to assess the accuracy of thetesting machine 124. Furthermore, the computer program 110 can beconfigured to automatically generate the pass/fail report 170.

In one embodiment, the computer program 110 can be implemented in alocal computer application that can reside on the LINAC machine 120. Inthis embodiment, other components of the system 100 such as the analysissoftware 140, machine performance data 130, tolerance data 160, and/orthe reference data 150 can also reside on the LINAC machine 120. TheLINAC machine can be configured to include a memory that can store thereference data 150, the machine performance data 130, and/or thetolerance data 160.

In an alternative embodiment, the computer program 110 can reside on anexternal device or computer (not shown). The external device can beconfigured to communicate with the LINAC machine 120 and/or the analysissoftware 140. In this embodiment, a user can control the LINAC machine120 via the external device which preferably includes appropriate input,output, and/or display devices. Alternatively, the analysis software 140or other data such as the machine performance data 130, the referencedata 150, and/or the tolerance data 160 can also reside on the externaldevice or computer.

In another alternative embodiment, the analysis software 140 can beimplemented in a service-based system. The service-based systempreferably provides network accessibility to the users of the system100. In this embodiment, the users of the system 100 are capable ofaccessing and analyzing the reference data 150, tolerance data 160,machine performance data 130, and/or pass/fail report 170 stored in theservice-based system. For example, the system 100 provides anenvironment for benchmarking a set of reference data available for othersimilar machines. Any user with proper authority can access theservice-based system where the reference data 150 is stored and canbenchmark the reference data 150 for calibration of their LINACmachines. The service-based system can be configured as a cloud networkbut any other computing network with suitable networking capability canbe implemented.

FIG. 2 illustrates an exemplary workflow of the computer program 110 ofFIG. 1 and is generally indicated by numeral 200. In the description ofthe flowcharts, the functional explanation marked with numerals in anglebrackets, <nnn>, will refer to the flowchart blocks bearing that number.In this illustrative, but non-limiting exemplary workflow, the computerprogram 110 is comprised of an XML code. An XML beam script is encodedfirst <210>. The XML beam script is coded to perform a variety of teststhat can be performed by an EPID, for example, mechanical QA (qualityassurance), Winston-Lutz test, Beam Flatness test, Beam Symmetry test,Light-Radiation comparison test, and MLC QA <220>. It should beunderstood that these tests are introduced only as an example and shouldnot be used to limit the scope of the present invention. Any other testsuitable for testing an EPID can be encoded as part of the beam script.

Next, the XML script is transferred and loaded to the treatment machinecontrol system 100 (or the LINAC machine 120) <230>. In the alternativeembodiment, the XML script can be loaded <240> to the external device(not shown). The system 100 (or the LINAC machine 120) is configured torun or execute the automated XML script <250> in a mode that may bedesignated as “BeamON” mode, and subsequently operates the testingmachine 124 to acquire images from the EPID <260>.

Next, the XML script loaded to the system 100 <240> (or the LINACmachine 120) is operated to control the analysis software 140 in orderto analyze the EPID-captured images <270> of radiation. The XML scriptloaded to the system 100 (or the LINAC machine 120) finally is executedto produce the pass/fail report 170 based on the analysis performed bythe analysis software 140 <280>.

In an alternative embodiment, the XML script can be loaded to theexternal device or computer as described above. In this alternativeembodiment, the external device can be configured to communicate withthe LINAC machine 120 to execute the processes described above inconjunction with FIG. 2 .

In another alternative embodiment, the XML script can be loaded to theservice-based system as described above. In this alternative embodiment,the XML script can be configured to automatically control the stepsdescribed in conjunction with FIG. 2 at the service-based system. Theusers of the system 100 can access the service-based system andcommission their testing machine by using the automated XML script thatresides on the service-based system.

FIG. 3 illustrates an example of relative measurements performed by theLINAC machine 120 of FIG. 1 using a photon radiation beam. The data inFIG. 3 was collected for open field photon beams. In FIG. 3 , beamenergy changes, e.g., percent depth dose, over the full range ofadjustment were measured by the LINAC machine 120. FIG. 3 shows how beamenergy changes were detected with relative measurements. A set oftolerance data relates the relative measurements and changes to absolutetolerances. Open field images were obtained at the EPID of the LINACmachine 120 at different bending magnet current settings. Based on themeasurements, FIG. 3 shows the flatness of the beam changes whencompared against the baseline data. The flatness of photon beams isextremely sensitive to change in energy of the incident beam. A smallchange in the penetrative quality of a photon beam results in very largechange in beam flatness. The proposed system of FIG. 1 uses similarrelative measurements to characterize the reference machine 122 in thenew paradigm for acceptance and commissioning of a LINAC 120 machinewhere these relative changes can be related to absolute energy changesand conventionally established tolerances.

FIG. 3A illustrates an example of relative measurements performed by theLINAC machine 120 of FIG. 1 using an electron beam. The data in FIG. 3Ashows a series of baseline measurements for an electron beam of thereference machine 122 showing the consistency in LINAC performance andrepeatability of said measurements. The data shown in FIG. 3A also showstolerance data measurements for energies which are high and low withrespect to the nominal baseline energies. The data in FIG. 3A wascollected with a small plastic wedge inserted in the electron beam. Theplastic wedge in these measurements is only for illustrative purposes.It should be understood that objects other than the plastic wedge can beinserted into the beam to enhance the sensitivity and ease of the saidmeasurements. It should also be understood that these objects can bemade of materials other than plastic and that any object which createsdifferential radiation fluence or increases radiation sensitivity can beused. The data shown in FIG. 3A demonstrates ability of the proposedsystem of FIG. 1 to be used for acceptance testing and commissioning ofelectron beams of a LINAC machine 120 relative to the reference machine122.

FIG. 4 illustrates a flowchart of a method for acceptance testing andcommissioning of a LINAC according to an illustrative, but nonlimiting,exemplary embodiment and is generally indicated by numeral 400. At step<410>, a reference machine 122 is calibrated according to one of theindustry standards, for example, the standards provided by the ADCL. Atstep <420>, the system 100 collects the reference data 150 from thereference machine 122. As described above, the reference data 150represents a correlation between the parameters and radiationmeasurement of the reference machine 122. At step <430>, the system 100stores the collected reference data 150 in a memory. At step <440>, thesystem 100 collects the machine performance data 130 from a testingmachine 124. As described above, the machine performance data 130represents a correlation between the parameters and radiationmeasurement of the testing machine 124. At step <450>, the system 100analyzes accuracy of the testing machine 124 by comparing the referencedata 150 with the machine performance data 130. For example, theanalysis software 140 of FIG. 1 compares the reference data 150 with themachine performance data 130 to determine the differences between two.If the differences are within acceptable criteria then the analysissoftware 140, at step <460>, generates a pass report 170. If thedifferences are not within acceptable criteria then the analysissoftware 140, at step <460>, generates a fail report 170. The acceptablecriteria can be calculated by Equation (1) described above or any othercompatible method that takes into account the relative relationshipbetween the machine performance data 130 and the reference data 150. Inthe exemplary embodiment of FIG. 4 , at least the steps <440>, <450>,and <460> can be automated by using the computer program 110 of FIG. 1as described in FIG. 2 . As shown in FIG. 2 , the computer program 110can be encoded to automate the steps of <440>, <450>, and <460>.

2. TPS Commissioning

Historically, the radiotherapy treatment planning system (TPS)commissioning and implementation relied on data specifically collectedfor individual LINAC or standard input data provided for a model of anindividual LINAC. The acceptance testing and commissioning of treatmentplanning system were performed by medical physicists by inputting theirown images or standard images provided for specific tests and thenmanually creating treatment plans and software steps to test thetreatment planning system. As such, to the extent that variable data isprovided to a TPS, its outputs are variable. Since all of local data isunique, any performance variability in the system is to some extentexpected due to the variability of input data. The end user is thenfaced with analyzing result data and sorting out any performancevariations caused by either the variability of input data or anincorrect performance or configuration of TPS software.

In the proposed method or system for TPS commissioning, a set ofstandard input data is collected and analyzed to create a set ofreference data. By inputting standard input data and standard plans intoa TPS, it is expected to have a standard set of results. Any variabilityin the expected results will be most likely due to an incorrectperformance or configuration of a TPS. This process would improve theefficiency of TPS commissioning. In addition, any real problems with thesystem can be more readily identifiable and reliance on the expertiseand competence of the end user for identifying actual system performanceissues from performance variability due to the variability of input datacan be reduced.

FIG. 5 is a schematic block diagram of an illustrative, but nonlimiting,system for an exemplary embodiment of a TPS commissioning system that isgenerally indicated by numeral 500. The illustrative, but nonlimiting,exemplary system of FIG. 5 may include standard beam data 510, standardimages data 520, standard contour data 530, standard treatment plans540, standard tests 550, a test performance engine 560, a treatmentplanning system 570, analysis software 580, standard reference data 590,and a pass/fail report 595.

In the exemplary embodiment, the system 500 collects the standardreference data 590. The standard reference data 590 is comprised of aplurality of standard treatment plans and their correspondingpredetermined results. The predetermined results of standard treatmentplans are collected by inputting standard input data to the system 500and performing various TPS functions with the standard input data. Forexample, the standard treatment plans are performed by the treatmentplanning system 570 that takes the standard input data as an input. Thetreatment planning system 570 is configured to collect the results ofthe standard treatment plans. The standard input data comprises thestandard beam data 510, standard images data 520, standard contour data530, and/or standard treatment plans 540. The standard beam data 510 cancomprise any data representing various information about radiation,e.g., quality, beam energy, radiation type, profiles, etc., in relationto a LINAC. The standard image data 520 can comprise any datarepresenting images of phantoms or humans captured with computedtomography imaging, magnetic resonance imaging, positron emissiontomography, etc. The standard contour data 530 can comprise any datarepresenting the typical contour of a human body to which radiation isapplied and/or contours applied to unique features of individualphantoms. The standard treatment plans 540 can comprise any datarepresenting standard plans of applying radiation to a human body formedical purposes and/or to phantoms for testing of specific performanceparameters of TPS. It should be understood that any other suitable typeof information/data can be used to represent standard input data forthis exemplary embodiment. The examples of the standard input dataprovided herein should not be used to limit the scope of the presentinvention. The standard reference data 590 and the standard input datacan be stored in a memory (not shown) residing on the system 500.Alternatively, any external memory device can be used to store thestandard reference data 590 and the standard input data.

After the collection process is completed, the system 500 performs acommissioning process. In the exemplary embodiment, the test performanceengine 560 is configured to perform standard tests 550 using thestandard input data such as the standard beam data 510, standard imagesdata 520, standard contour data 530, and/or standard treatment plans 540as an input. The standard tests 550 comprise various tests recommendedby professional medical societies, regulatory bodies, and other agenciessuch as the AAPM and ACR.

The results of the standard tests 550 are analyzed by the analysissoftware 580. The analysis software 580 compares actual test performanceresults of the standard tests 550 with predetermined results of thestandard treatment plans as represented by the standard reference data590 and determines whether each test performance result meets a certaintolerance standard. The tolerance standard defines pre-determinedacceptance criteria for corresponding standard tests. Preferably, thetolerance standard can be one of the published standards, for example,provided by the AAPM Task Groups. If the test performance result meetsthe tolerance standard that corresponds to the performed standard test550 then the analysis software 580 generates a pass report 595. If thetest performance result fails to meet the tolerance standard thatcorresponds to the performed standard test then the analysis software580 generates a fail report 595.

In the exemplary embodiment, the test performance engine 560 can beconfigured to automatically perform the testing of standard tests 550,comparing the test performance results with the reference data 150,and/or determining whether the test performance results meet thetolerance standard.

The system 500 may include a software application (not shown) thatcomprises the test performance engine 560 and/or analysis software 580.In this embodiment, the software application can be configured toautomate the processes of performing the standard tests 550, comparingthe test performance results with the reference data, and determiningwhether the test performance results meet the tolerance standard.Alternatively, the software application can be configured toautomatically perform such steps in a pre-determined time interval. Inthis embodiment, the user of the system 500 can be provided with a userinterface which can be used to enter a proposed interval time into thesystem 500. The predefined time interval could be set to correspond withtesting requirements and recommendations provided by regulatory bodies,national and international organizations, and various medical societies,for example. Furthermore, the software application can be configuredwhere use of software or an explicit override is required when any ofthe automatic and predefined tests fail to meet the tolerance standard.

This embodiment of integrated and automatic testing would significantlyimprove the reliability of system implementation, testing integrity andreliability, conformance of testing requirements and testing frequency,and communication and transparency of system functionality andconfiguration. This exemplary embodiment can automatically prevent useof unsafe and/or substandard treatment planning systems. Furthermore,the automatic testing significantly lessens the reliance on theexpertise of the end users for test performance and result analysis andinterpretation. As such, the developed system would ensure correct andconsistent operation of treatment planning systems independent of theend user experience, training, and proficiency levels.

In another embodiment, the system 500 or the analysis software 580 canbe configured to automatically communicate with a medical serviceprovider, e.g., hospital staff, administration, manufacturer, or otherstakeholders, to inform a test performance result when the testperformance result is determined to be failing to meet the tolerancestandard. In this embodiment, any communication means can be employed toprovide data connection between the system 500 and a medical serviceprovider such as the Internet, wireless network, cellular network, fax,conventional telephone line, etc.

In another alternative embodiment, the system 100 of EPID commissioningcan be interfaced with the system 500 of TPS commissioning. A set ofautomatic test routines for testing the LINAC machine 120 of FIG. 1 andthe treatment planning system 570 can be configured to ensureconsistency between two systems and any changes or modifications ineither the LINAC machine 120 or the treatment planning system 570 can bedirectly coupled to testing of the other system to ensure consistency ofoperation. The results of LINAC test analysis by the analysis software140 of FIG. 1 can be used to automatically drive testing of treatmentplanning system 570 of FIG. 5 and conversely, the results of treatmentplanning system tests obtained from the analysis software 580 of FIG. 5can be used to drive testing of LINAC machine 120 of FIG. 1 . Thisapproach ensures codependence of system performance between the LINACmachine 120 and the treatment planning system 570 and thereforesignificantly increases the confidence and accuracy of patienttreatments. For example, the testing machine 124 that has beencommissioned by the system 100 of FIG. 1 can be used to perform one ofthe standard tests of FIG. 5 and any pass/fail report generated by theanalysis software 140 of FIG. 1 can be used for the system 500 indetermining whether certain standard tests are performed with avalidated LINAC. Conversely, standard beam data 510 and/or standardreference data 590 from FIG. 5 can be used to generate tolerance data160 in FIG. 1 , therefore closing the loop between the configuration andperformance of LINAC and TPS.

In another alternative embodiment, the testing performance engine 560and/or analysis software 580 can be implemented in a service-basedsystem. The service-based system preferably provides networkaccessibility to the users of the system 500. In this embodiment, theusers of the system 500 are capable of accessing and analyzing thestandard input data, standard tests 550, standard reference data 590,and/or pass/fail report 595 stored in the service-based system. Forexample, the system 100 provides an environment for benchmarking a setof standard reference data 590 available for other similar test planningsystems. Any user with proper authority can access the service-basedsystem where the standard reference data 590 is stored and can benchmarkthe standard reference data 590 for calibration of their test planningsystems. The service-based system can be configured as a cloud networkbut any other computing network with suitable networking capability canbe implemented.

In this alternative embodiment, the system 100 of FIG. 1 and the system500 of FIG. 5 can be connected to an external interface (manufacturer,cloud infrastructure, etc.) where the data and testing content of thesesystems are automatically updated. This embodiment would promoteautomatic updating of testing standard and requirements. Any changes intesting procedures, testing standards, testing tolerances, could beautomatically and simultaneously deployed to all user sites ensuringtimely implementation of any changes. Furthermore, with this approach,any regulatory (e.g., Federal Drug Administration) software recalls andaudits can be automatically deployed, executed, and tested with the mostup to data, procedures, and software. This approach would greatlyincrease the compliance with regulatory requirements and enforcementsand would significantly improve confidence that all systems (eitheractive or inactive) that are deployed in the field are functioningcorrectly.

FIG. 6 depicts a flowchart of a method for acceptance testing andcommissioning of the TPS system 500 of FIG. 5 and is generally indicatedby numeral 600. At step <610>, the system 500 collects the standardreference data 590. As described above, the standard reference data 590comprises a plurality of standard treatment plans and theircorresponding predetermined results. At step <620>, the system 500stores the standard reference data in a memory. At step <630>, the testperformance engine 560 of the system 500 performs the standard tests 550using standard input data as an input. A test performance resultcorresponding to each standard test is generated. In this embodiment, atleast one standard test can be configured to use the testing machine 124of FIG. 1 in order to measure radiation generated by the LINAC of thetesting machine 124. At step <640>, the analysis software 580 of thesystem 500 compares the test performance results of the standard tests550 with the predetermined results of the standard treatment plans asrepresented by the standard reference data 590. At step <650>, theanalysis software of the system 500 determines whether each testperformance result meets a tolerance standard. In this exemplaryembodiment, the test performance engine can be configured toautomatically execute at least the steps of <630>, <640>, and <650>.

Furthermore, it should be understood that when introducing elements ofthe present invention in the claims or in the above description of thepreferred embodiment of the invention, the terms “have,” “having,”“includes” and “including” and similar terms as used in the foregoingspecification are used in the sense of “optional” or “may include” andnot as “required.” Similarly, the term “portion” should be construed asmeaning some or all of the item or element that it qualifies.

Thus, there have been shown and described several embodiments of a novelinvention. As is evident from the foregoing description, certain aspectsof the present invention are not limited by the particular details ofthe examples illustrated herein, and it is therefore contemplated thatother modifications and applications, or equivalents thereof, will occurto those skilled in the art. Many changes, modifications, variations andother uses and applications of the present construction will, however,become apparent to those skilled in the art after considering thespecification and the accompanying drawings. All such changes,modifications, variations and other uses and applications which do notdepart from the spirit and scope of the invention are deemed to becovered by the invention which is limited only by the claims thatfollow.

The invention claimed is:
 1. A method for acceptance testing andcommissioning a treatment planning system (TPS), said method comprising:collecting standard reference data wherein said standard reference datais composed of a plurality of treatment plans and predetermined resultsof such treatment plans; storing said standard reference data in amemory associated with at least one processor; performing, with a testperformance engine, a plurality of standard tests based on standardinput data wherein said test performance engine generates at least onetest performance result for each standard test wherein said processor isconfigured to execute said test performance engine; automaticallycomparing, with an analysis software program, said test performanceresult with said standard reference data wherein said test performanceresult is compared with at least one predetermined result of saidtreatment plan wherein said processor is configured to execute saidanalysis software program, wherein said comparing includes defining arelationship between said standard reference data and said testperformance result; and automatically determining, with said analysissoftware program, and based on a result of said comparing, whether eachsaid test performance result meets a tolerance standard wherein saidtolerance standard is a pre-determined standard corresponding to atleast one of said standard tests.
 2. The method for acceptance testingand commissioning a treatment planning system (TPS) of claim 1, whereinsaid steps of performing, comparing, and determining are performed by asoftware application wherein said software application comprises saidtest performance engine and said analysis software program.
 3. Themethod for acceptance testing and commissioning a treatment planningsystem (TPS) of claim 2, wherein said software application is configuredto automatically perform said step of performing.
 4. The method foracceptance testing and commissioning a treatment planning system (TPS)of claim 3, wherein said software application is configured to performsaid steps of performing, comparing, and determining in a pre-determinedtime interval.
 5. The method for acceptance testing and commissioning atreatment planning system (TPS) of claim 2, wherein said analysissoftware program is configured to automatically communicate to a medicalservice provider of said test performance result when said testperformance result fails to meet said tolerance standard.
 6. The methodfor acceptance testing and commissioning a treatment planning system(TPS) of claim 2, wherein said software application resides on aservice-based system wherein said standard reference data is stored insaid service-based system.
 7. The method for acceptance testing andcommissioning a treatment planning system (TPS) of claim 1, wherein saidstandard input data comprises standard beam data, standard images data,standard contour data, and standard treatment plans.
 8. A system foracceptance testing and commissioning a treatment planning system (TPS),said system comprising: a memory storing standard reference data whereinsaid standard reference data is composed of a plurality of treatmentplans and predetermined results of such treatment plans; and a processorassociated with said memory having a test performance engine performinga plurality of standard tests based on standard input data andgenerating at least one test performance result for each standard testand an analysis software program automatically comparing said testperformance result with said standard reference data wherein said testperformance result is compared with at least one predetermined result ofsaid treatment plan, wherein said comparing includes defining arelationship between said standard reference data and said testperformance result and automatically determining based on a result ofsaid comparing whether each said test performance result meets atolerance standard wherein said tolerance standard is a pre-determinedstandard corresponding to at least one of said standard tests, whereinsaid processor is configured to execute said test performance engine andanalysis software program.
 9. The system for acceptance testing andcommissioning a treatment planning system (TPS) of claim 8, wherein saidtest performance engine and analysis software program are configured toautomatically perform said process of performing said standard tests.10. The system for acceptance testing and commissioning a treatmentplanning system (TPS) of claim 9, wherein said test performance engineand analysis software program are configured to automatically performsaid processes of performing said standard tests, comparing said testperformance result with said standard reference data, and determiningwhether said test performance results meets a tolerance standard in apre-determined time interval.
 11. The system for acceptance testing andcommissioning a treatment planning system (TPS) of claim 9, wherein saidtest performance engine and analysis software program are configured toautomatically communicate to a medical service provider of said testperformance result when said test performance result fails to meet saidtolerance standard.
 12. The system for acceptance testing andcommissioning a treatment planning system (TPS) of claim 8, wherein saidtest performance engine and analysis software program reside on aservice-based system wherein said reference data is stored in saidservice-based system.
 13. The system for acceptance testing andcommissioning a treatment planning system (TPS) of claim 8, wherein saidstandard input data comprises standard beam data, standard images data,standard contour data, and standard treatment plans.